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Description 

[0001] This application is based on application No H11-233760 filed in Japan on August 20, 1999. the entire con- 
tents of which are hereby incorporated by reference. 

5 

BACKGROUND OF THE INVENTION 

Field of the Invention 

10 [0002] The present invention relates to an image input apparatus that forms an image through a plurality of minute- 
image-fonnation optical systems. 

Description of the Prior Art 

15 [0003] In recent years, with the advent of highly information-oriented society brought by the development of com- 
munications media, there has been a keen demand for acquiring various kinds of information effectively and timely. 
Such information includes a very large proportion of image information, and therefore recording and saving of image 
information are essential for conducting advanced infomnation processing activities. Conventionally, apparatuses such 
as photographic cameras and video cameras have been used for recording and saving image infomnation. However, it 

20 is impossible to miniaturize beyond a certain limit such apparatuses by making their constituent components smaller, 
and therefore, to realize apparatuses so compact as to be portable all the time, it is necessary, and in fact expected, to 
develop a compact image input apparatus based on a novel construction. 

[0004] An arrangement conventionally known to help miniaturize an image input apparatus makes use of a lens 
array composed of a plurality of microlenses combined together. This is an application of the compound-eye seen in the 
25 visual system of insects, and helps realize an optical system that occupies less volume, offers a wider angle of view, 
and is brighter than a "single-eye" image fonnation system. 

[0005] As a conventional image input apparatus adopting this anBngement, for example, Japanese Published Pat- 
ent Application No. S59-50042 discloses an image input apparatus composed of a microlens an^y, a pinhole anay, and 
an image surface. Here, the microlenses form a reduced image of an object, and the pinholes, paired one to one with 
30 the microlenses, sample different parts of this reduced image, fonning together an image of the object on the image 
surface. 

[0006] As another example, Japanese Laid-Open Patent Application No. H5-100186 discloses an image input 
apparatus composed of a microlens array, a pinhole an^y, and a photosensitive element array Here, the microlenses, 
pinholes, and photosensitive elements are grouped into units each composed of a microlens, a pinhole, and a photo- 
35 sensitive element, and the individual units convert optical signals received from different parts of an object (subject) into 
electric signals, that together represent image infomnation. 

[0007] As still another example, Japanese Laid-Open Patent Application No. H 1 0-1 07975 discloses an image input 
apparatus in which a plurality of photosensitive elements are arranged for each of microlenses. Here, the image of an 
object formed by the microlenses is not sampled by pinholes that individually sample different parts thereof, but is 

40 directly read by a two-dimensionalty extending photosensitive element array that yields signals of minute images. Here, 
an aperture stop is an^nged on the object side of the photosensitive element array and the microlens anray, and the 
individual microlenses observe different parts of the object with no overlap among the signals obtained. 
[0008] However, the image input apparatuses disclosed in Japanese Published Patent Application No. S59-50042 
and Japanese Laid-Open Patent Application No. H5-100186 mentioned above both have basically the same optical 

45 system, and sufferfrom unsatisfactory resolution in the image signals obtained. Specifically, in a lens-pinhole type com- 
pound-eye optical system, the number of units each including a microlens and a photosensitive element coincides with 
the number of dots, i.e. resolution, of the obtained image, therefore it is inevitable to increase the number of units to 
obtain a high-resolution image. However, even a microlens needs to have a certain size to function satisfactorily as a 
lens, and therefore, in this compound-eye optical system, it is impossible to increase beyond a certain limit the number 

50 of units even if the microlens are arranged in a closest packed structure. As a result, it is difficult to obtain a high-reso- 
lution image. 

[0009] On the other hand, the arrangement disclosed in Japanese Laid-Open Patent Application No. H1 0-1 07975 
mentioned above solves the problem of unsatisfactory resolution in the image signals obtained, but, to obtain the best 
optical characteristics in this optical system, it is necessary to arrange the microlens array and the photosensitive ele- 
55 ment array on a spherical surface having its center at the aperture stop, and thus this an^ngement is not fit for the pur- 
pose of making the entire image input apparatus satisfactorily compact. In particular, the individual photosensitive 
elements need to be arranged at discrete locations on a curved surface, i.e. a spherical surface In this case. This makes 
the photosensitive elements difficult to arrange in desired positions, and thus makes the entire image input apparatus 
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difficult to manufacture. 

[0010] In another invention, no aperture stop is used, and a nnicrotens array and a photosensitive element anBy are 
each arranged on a flat plane. However, here, to prevent interference between the optical signals from adjacent micro- 
lenses, the photosensitive element array needs to be arranged at a certain distance from the microlens array, and thus 
5 the photosensitive element array requires an unduly large fitting area. In addition, this arrangement is specialized for 
nan-ow object angles at the cost of optical characteristics, and therefore exhibits various drawbacks in practical use. 

SUMMARY OF THE INVENTION 

TO [001 1] An object of the present invention is to provide an image input apparatus that has a simple construction, that 
is more compact than ever, and that offers high-resolution images. 

[0012] To achieve the above object, according to the present invention, an image input apparatus is provided with: 
a photoelectric converter element having a flat photosensitive surface; and an image formation unit array having a plu- 
rality of image formation units arranged in an array. Here, the plurality of image formation units individually receive light 
15 beams substantially from an identical area and focus the received light beams on different regions of the photosensitive 
surface of the photoelectric converter element to fonri images thereon. 

BRIEF DESCRIPTION OF THE DRAWINGS 

20 [001 3] This and other objects and features of this invention will become clear from the following description, taken 
in conjunction with the pretended embodiments with reference to the accompanied drawings in whfch: 

Fig. 1 is an exploded perspective view schematically showing an image input apparatus embodying the invention; 
Fig. 2 is a vertical sectional view schematically showing the optical systems of two adjacent units in an image input 
25 apparatus embodying the invention; 

Figs. 3A to 3D are perspective views schematically showing the manufacturing process of diffractive optical lenses; 
Figs. 4A to 40 are diagrams schematically showing the manufacturing process of refractive lenses; 
Fig. 5 is a diagram showing the multiple reduced images formed by the lens array; 

Fig. 6 is a diagram showing an image reconstructed by gathering the signals obtained from the pixels at the center 
30 of the units; 

Fig. 7 is a diagram showing an Image reconstructed by using the signals obtained from all the photosensitive ele- 
ments; 

Fig. 8 is a perspective view schematically showing a signal separation polarizing filter; 

Figs. 9A and 9B are perspective views schematically showing the configuration of the signal processing system for 
35 processing optical signals; 

Fig. 1 0 is a diagram schematically Illustrating the relationship between the photosensitive area and the minute view 

angle; 

Fig. 11 is a diagram schematically showing the relationship between the object and the view angle of the image 
input apparatus; 

40 Figs. 12A and 12B are diagrams schematically showing the principle of making the view angle of the image Input 
apparatus wider; 

Fig. 13 is a diagram schematically illustrating deflection caused by decentering of the image fomiation elements; 
Fig. 14 is a diagram schematically illustrating deflection caused by a diffraction grating; and 
Fig. 15 is a perspective view schematically showing the construction of an image input apparatus employing dis- 
45 pensive elements. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[0014] Hereinafter, embodiments of the present invention will be described with reference to the drawings. This 
50 invention provides a slim type image input apparatus in which a single plane photosensitive element array is divided into 
areas each con'esponding to one microlens so that each area includes a plurality of photosensitive elements, and in 
addition partition walls are provided to prevent interference among the optical signals from the individual microlenses. 
Fig. 1 is an exploded perspective view schematically showing an image input apparatus embodying the Invention. 
[0015] In Fig. 1 , reference numeral 1 represents a microlens array having microlenses la arranged in a two-dimen- 
55 sional array, in a square shape for example, and reference numeral 3 represents a photosensitive element array dis- 
posed below the microlens anBy 1 so as to face it and having photosensitive elements 3a arranged similarly In a two- 
dimensional array, in a square shape for example. Reference numeral 2 represents a partition wall layer disposed 
between microlens array 1 and photosensitive element array 3 and composed of partition walls 2a that are arranged 
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below the boundaries of the individual nnicrolenses 1a of the microlens array 1 so as to forna a grid-like structure. 
[0016] As shown In Fig. 1, one microlens la of the microlens array 1 corresponds to a plurality of photosensitive 
elements 3a of the photosensitive element an^y 3, and corresponds to one compartment formed in between in the par- 
tition wall layer 2. As an imaginary square prism drawn with broken lines indicates, these together form a signal 

5 processing unit U. The individual units are separated from one another by the partition walls 2a to prevent the optical 
signal from one microlens la from entering the adjacent units; that is, the optical path through each unit is restricted. 
As the photosensitive element array 3. it is possible to use a solid-state image-sensing device such as a CCD. This 
helps reduce the number of components needed and thereby simplify the construction of the image input apparatus. 
[0017] Fig. 2 is a vertical sectional view schematically showing the optical systems of two adjacent ones among 

10 those units. In this figure, when an image of an object (not shown) located above the apparatus is focused within the 
target unit U1 , the light beam LI coming from the object as a rightful optical signal strikes the microlens la belonging 
to the unit U1 by traveling parallel to the optical axis X1 thereof. Then, the light beam is condensed by that microlens 
la on the photosensitive element array 3 belonging to the unit U1. At this time, if a light beam L2, as an unnecessary 
optical signal, enters the adjacent unit U2 by traveling obliquely from a direction opposite to the target unit U1 at a large 

15 angle relative to the optical axis X2 of the microlens la belonging to the unit U2, this unnecessary light beam L2 also 
Is focused on the photosensitive element array 3 belonging to the target unit U1 . 

[0018] It is for the purpose of preventing such interference that the partition walls 2a, as shown in Fig. 2, are pro- 
vided between the units. It is needles to say that interference is perfectly prevented if the partition walls are formed so 

as to extend from the microlenses la to the photosensitive element array 3. However, even if the partition walls are 
20 formed partially, they effectively reduce unnecessary signals. When the partition walls 2 are fomied so as to extend ver- 
tically from the microlenses 1 downward, as shown in Rg. 2, for each unit, the following fonnuia (1) holds: 

x=(a-c)d/2c (1) 

25 where 

X represents the width of the area struck by an optical signal coming from an adjacent unit and having half the 
amount of light per microlens; 

30 a represents the distance between the microlens and the photosensitive element; 

c represents the height of the partition walls; 

d represents the width of the unit. 

35 

[0019] In this case, it is not possible to perfectly prevent interference; however, the higher the partition walls are 
made, the less interference occurs. How much the Interference among signals affects the image information eventually 
obtained can be evaluated practically by simulation or the like. 

[0020] Regarding the microlens array mentioned above, the sizes of the whole microlens array and of each unit, the 
40 number of microlenses, the focal length, the manufacturing process will be presented below. Here, two types of micro- 
lens array, one using diffractive optica! lenses and the other using refractive lenses, are presented. Moreover, as the 
type using diffractive optical lenses, two examples of different sizes are presented. 



Table 1 



((Diffractive Optical Lens Type)) 


Unit pitch 


176|Lim 


250 ^im 


Overall size 


8.8mm x 6.7mm (50 x 38 units) 


15mm X 15mm (60 x 60 units) 


Focal length 


176 \im 


250 \vm 



• Manufacturing Process 

55 [0021 ] The manufacturing process of diffraction optical lenses is shown in Figs. 3A to 3D. First, as shown in Fig. 3A, 
a resist R is applied to the surface of a glass substrate G. As this resist R, an electron resist is used. Next, as shown in 
Fig. 3B, by using an electron beam drawing machine, the desired pattern Pn is drawn on the resist R. Then, as shown 
in Fig. 30, the drawn pattern is developed. Finally, as shown in Fig. 3D, the drawn and developed pattern is transferred 
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onto the glass substrate G by using an etching naachine. 

[0022] The drawn pattern consists of Fresnel zone plates of either a binary or a multilevel type. Prototype lens 
arrays currently being manufactured have a minimum line width of 0.4 jim with binary-type zone plates and 0.2 \im with 
multilevel-type zone plates. When the minimum line width is as wide as about 1 \im, a laser beam can be used to draw 
5 the pattern. 



Table 2 



((Refractive Lens Type)) 


Unit pitch 


176 \im 


250 nm 


Overall size 


8.8mm x 6.7mm (50 x 38 units) 


15mm X 15mm (60 x 60 units) 


Focal length 


about 230 >im 


about 350 ^m 



15 

• Manufacturing Process 

[0023] Figs. 4A to 4D show the manufacturing process of refractive lenses. A so-called themial re-flow method is 
applied here. First, as shown in Fig. 4A, a glass substrate G having a photo resist PR applied to its surface is coated 

20 with a mask M having a pattern drawn thereon. Then, the glass substrate G is exposed to light from above as indicated 
by an-ows W. The pattern is thus transferred onto the photo resist PR by so-called photo I'lthography. Here, unlike diffrac- 
tive optical tenses, the pattern consists not of Fresnel zone plates but of an array of circles that is used as a mask. 
[0024] After exposure and then development, as shown in Fig. 4B, the resist remains as a pattern of cylindrical 
patches. As shown in Fig. 4C, when these remaining resist patches are post-baked by using a hotplate or an oven, they 

25 melt and fomn into the shapes of lenses by their own surface tension. As shown in Fig. 4D, by etching these resist 
patches, the resist patter is transferred onto the glass substrate G. Quartz is the typical material of the glass substrate 
G. The thermal re-flow method mentioned above is described in: "Micro-optics" by Hans Peter Herzig, p132-p136, pub- 
lished 1 997 by Taylor & Francis. 

[0025] The partition walls mentioned above need to meet the following requirements: 

30 

1 . The partition walls should be as thin as possible. 

2. The partition walls should preferably extend from the microlenses to the photosensitive element surface. 

3. The partition walls should be opaque and should reflect or scatter as little light as possible. 

35 [0026] In practice, the partition walls are produced, for example, by cutting a metal with a laser, or by three-dimen- 
sionally molding a photo-setting resin. As an example produced by cutting a metal with a laser, prototype partition walls 
having a thickness of 20 ^m and arranged at intervals of 250 ^m are produced from a stainless steel plate having a 
thickness of 200 jim. Here, to prevent reflection, the surfaces of the partition walls are blackened. 
[0027] As an example produced by three-dimensionalty molding a photo-setting resin, prototype partition walls are 

40 produced by scanning with a laser beam a resin called pentaerythrltol triacrilate (PETA), which has a highly self-focus- 
ing property against light entering it, with 3% of benzil added thereto as a photopolymerization starter. It Is confinmed 
that the partition walls thus produced have a thickness of about 56 \vm and a height of about 500 ^m. 
[0028] How, the image obtained by using the image input apparatus of this embodiment will be described. Fig. 5 is 
a diagram of multiple reduced images formed by the lens array. The lens array used here is an array of gradient-index 

45 plane microlenses produced by ion exchange that have a focal length of 650 jim, have an aperture diameter of 250 jim, 
and are arranged at intervals of 250 ^im. The photosensitive element used here is a CCD image-sensing device with 
739 x 575 elements each having an aperture of 11 nm x 11 urn. In this case, approximately 22.7 x 22.7 elements con- 
stitute one unit. Although the number of elements that constitute one unit is not an integer number here, this does not 
affect the final image. 

50 [0029] Fig. 6 is a diagram showing an image reconstructed by gathering the signals obtained from the pixels at the 
centers of the units. As shown in this figure, an erect image of the object is obtained. Fig. 7 is a diagram showing an 
image reconstructed by using the signals obtained from all the photosensitive elements by an inverse matrix method. 
As shown in this figure, a satisfactory image is obtained. 

[0030] Separation of adjacent signals as described above can also be achieved with a combination of polarizing fil- 
55 ters, instead of using partition walls as described above. Fig. 8 is a perspective view schematically showing such polar- 
izing filters. As shown in this figure, this polarizing filter array 4 is divided into blocks 4a each corresponding to one unit 
described above and has polarized light transmitting filters an^nged in a checkered pattern such that every two adja- 
cent filters have mutually perpendicular polarization directions. Two such polarizing filter arrays are prepared and 
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arranged one at the nnicrolens anBy surface and the other at the photosensitive element surface shown in Fig. 1 with 
each polarizing filter aligned with the corresponding unit. 

[0031] Here, with respect to a given unit, the filter blocks 4a adjacent thereto upward, downward, leftward, and right- 
ward transmit only light polarized perpendicularly to the polarization direction of the filter block of the given unit. Thus, 
5 interference among the optical signals entering these adjacent units Is prevented. By selectively using the signals 
obtained through units of a particular polarization direction, it is possible to realize an image input apparatus that exhib- 
its different sensitivities in different polarization direction. 

[0032] As those polarizing filters, either diffractive optical elements or hybrid elements, i.e. diffractlve optical ele- 
ments and refractive optical elements combined together, are used. The polarizing filters, when composed of diffracth/e 

10 optical elements, is produced in the same manner as the diffractive lens anBy described above. That is, a resist pattern 
drawn by using an electric beam drawing machine is transferred onto a glass substrate by etching. Here, the pattern of 
the polarizing filters is basically of a binary type consisting of lines and spaces. A minimum line width of approximately 
0.2 MJTJ can be obtained by using currently available electric beam drawing machine. Like the microlens array, when a 
relatively large minimum line width suffices, a laser beam drawing machine can be used. 

15 [0033] Now, how this image input apparatus is used when it is used as an image input apparatus that exhibits dif- 
ferent sensitivities in different polarization directions will be described. In general, on the basis of polarization informa- 
tion of an object, it is possible to know physical properties, such as the dielectric constant, of the object. To conduct 
measurement with a high sensitivity, accurate alignment and the like are necessary. However, even with a compara- 
tively simple image input apparatus, it is possible to obtain general information regarding physical properties of an 

20 object. For example, when reflection occurs on the surface of a dielectric substance, it exhibits varying reflectances 
toward differently polarized light components. Thus, by observing polarization infomnation, it is possible to know the 
angle of the reflecting surface relative to the image input apparatus. 

[0034] For example, this technique can be applied in a measuring instrument for measuring the angle of a reflecting 
surface such as a glass plate. As other examples, this technique can be applied to measurement of stress distribution 
25 inside a transparent object such as a plastic plane, or in an image input apparatus, such as a polarizing filter used in a 
camera, which acquires an object image by separating images reflected from and transmitted through a glass plate. 
[0035] The total thickness of an image input apparatus embodying the present invention depends on the following 
parameters: 

(Thickness of the Glass Substrate) + (Focal Length of the Microlenses) + 

30 

(Thickness of the Photosensitive Elements) 

[0036] Figs. 9A and 9B are perspective views schematically showing the configuration of the signal processing sys- 
tem for processing the optical signals acquired by an image input apparatus of the invention. As shown in Fig, 9A, 
assume that the distance between the object 5 and the microlens array 1 is A, the distance between the microlens an-ay 

35 1 and the photosensitive element array 3 is B, and the intervals at which the individual units are arranged is D. Refer- 
ence symbol O represents the output signals obtained from the photosensitive element array 3. Moreover, suppose that 
the numbers of the column and row in which a unit of the image input apparatus lies are represented by p and q, and 
that, as shown in Fig. 9B, the minute image in the unit [p, q] (i.e. the input signal entering the unit) is expressed as I p q(x, 
y) and the choice function of the input signals is expressed as fp,q(x, y), then the output signal Opq is given by fonnula 

40 (2) below. 

Op.q = l)"p.q(X.y)tp.q(X,y)clxdy (2) 

[0037] In Fig. 9A, in individual regions E on the photosensitive element anay 3 (photoelectric converter element), 
45 images of the area (object 5) are fonned as object images 5a seen from different view points. The images obtained in 
the individual units are object images 5a shifted by a predetermined distance from one another on the photosensitive 
element array 3 in accordance with the arrangement of the object 5, the microlens an^y 1 . and the photosensitive ele- 
ment array 3. For simplicity's sake, assume that the microlens array 1 exerts no deflecting effect. Then the relative shift 
amount A in each unit is given by formula (3) below. 

50 

A=BD/A (3) 
Accordingly, using the input signal lo,o (x, y) of the unit [0, 0], the output signal of each unit is given by formula (4) below. 

^ Op.q = ' 0.0 (X-PA. y-qA) tp.q(X, y) dxdy (4) 

[0038] Here, by manipulating the choice function fpq (x, y) of each unit, it is possible to obtain various effects. For 
example, when only the signal at the unit origin is chosen, then f p q (x, y) = 5 (x. y), and hence the output signal is given 
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by formula (5) below. 

Op.q='o.o(-P^'-q^) 

5 This formula presents the image obtained by enlarging I o.o(x, y) by a factor of A/BD. Since Iq.o (x, y) represents an 
inverted image of the object enlarged by a factor of A/B, the aggregate of the output signals from the individual units O 
p q is equivalent to an erect image of the object enlarged by a factor of 1/D. 
[0039] Now, as another case, assume that formula (6) below is used as the unit choice function. 

10 fpq(x,y) = 5(x-ap.y-pq) (6) 

In this case, formula (2) above yields fonnula (7) below. 

Op.q='o.o{-P(^-a)'-q(^-P)} (7) 

15 

This formula indicates that an image of the object enlarged by a factor tJ (A-a)D in the x direction and by a factor of 
A/(A-P)D in the y direction is obtained. 

[0040] Now, as still another case, assume that formula (8) below is used as the unit choice function. 
20 f pq(x, y) = 5 {x-{P-p)A(cosO-1)-(Q-q)Asine, y+(P-p)Aslne-(Q-q)A(cosO-1)} (8) 

In this case, the output signal is given by fonnula (9) below. 

O p q =1 p,Q { (P-P) A cos e + (Q-q)A sin G, -{P-p)A sin 0 +(Q-q)A(cos 0} (9) 

25 

This formula represents an image equivalent to an image of the object rotated through G degrees counter-clockwise 
about the unit [P, Qj. 

[0041 ] Now, as a further case, assume that fomiula (10) below is used as the unit choice function. 

30 fpq(x,y)=6(x)rect(y/1y) (10) 

In this case, when input signals spreading in the y direction are chosen, the output signal is given by formula (11) below. 

Op.q = l''''.iy/2io.o(-pA.y-qA)dy ni) 

35 

This response characteristic can be used to extract the information of a line segment extending in the y direction. 
[0042] As described above, by varying the definition of the unit choice function f p q (x, y), the obtained image sig- 
nals can be processed in various ways. In an image input apparatus of the present invention, this can be achieved by 
specifying the addresses of the signals read out from the photosensitive element array. In other words, by calculating, 

40 using the signals from the photosensitive elements at the addresses corresponding to the choice function used, the out- 
put signals of the units they belong to, it is possible to obtain output signals con-esponding to formula (2). 
[0043] Note that, in an image input apparatus of the present invention, even if the constituent components are 
aligned insufficiently with one another in assembly, it is possible to obtain connect signals by processing the signals in 
an appropriate manner. Specifically, the procedure for achieving this is as follows. First, the partition walls are aligned 

45 with and then bonded to the microlens array, then the thus obtained Integral unit is arranged in close contact with the 
surface of the photosensitive element array. In this state, the apparatus Is already ready for use, but, to achieve more 
efficient use of the photosensitive element array and to facilitate post-processing, the above-mentioned integral unit is 
aligned with the photosensitive element array such that the partitions of the former are parallel with the regions of the 
latter. 

50 [0044] This is achieved by observing the moire fringes that are fomned by the shadow of the partition walls and the 
photosensitive regions when light is shone into the apparatus. In this adjustment procedure, the pixels that output 
bright-state signals are regarded as effective pixels from which to read actual optical signals, and therefore, by using 
the positions of these pixels, it is possible to know the con-espondence between the signals of the individual units and 
the addresses at which to read the outputs of the photosensitive elements. For example, unnecessary signals can be 

55 easily excluded by masking the other signals than those of the effective pixels after acquiring the data from all pixels. 
[0045] Incidentally, Ipq corresponds to the signal obtained from the photosensitive elements of the unit [p, qj. Thus, 
when the partition walls reach the photosensitive element surface. I p q represents the signals from the photosensitive 
elements except those located at the partition walls. When the partition walls do not reach the photosensitive element 
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surface. Ipq represents the signals from the photosensitive elements excluding the photosensitive regions where inter- 
ference is occurring. 

[0046] In an actual image input apparatus, fp q has finite sampling range and thus is a "reef function, i.e. a function 
that gives "1" within the range corresponding to the regions (minute view angles) participating in image sensing and that 
5 gives "0" outside that range. In Fig. 10, the relationship between the width ti of a pixel that senses light on the photo- 
sensitive element surface S and minute view angle P is given by fonnula (c) below. 

p=2tan'M^/2f) (c) 

10 where f represents the focal length of an image fonmation element IR The range of the rect function is detemnined by 
using this formula. 

[0047] Fig. 11 is a diagram schematically showing the relationship between the object and the field of view of the 
image input apparatus. This figure shows a case in which an image of an object 5 occupying an area extending over a 
length of X is formed on the photosensitive element an^y 3 through the microlenses L j j. Inverted, reduced images of 
15 the entire object 5 are formed through the individual microlenses of the microlens an-ay 1 on the corresponding regions 
of the photosensitive element an^y 3. Here, since the individual lenses of the microlens anBy 1 have different positional 
relationships with the object 5, the images formed on the individual regions of the photosensitive element anay 3 have 
different information from one another. This is exploited to reconstruct an image. 

[0048] Specifically, an image X of the entire object 5 is focused through each microlens L | j of the microlens an-ay 
20 1 , so as to form an image Z ( L | j ) on the corresponding region of the photosensitive element array 3. In other words, 
the same number of inverted, reversed images of the object surface 5b on the object 5 as that of microlenses in the 
microlens an^y 1 are formed on the image formation surface 3b of photosensitive element anBy 3. Here, since the indi- 
vidual regions of the photosensitive element array corresponding one to one to the individual lenses have different posi- 
tional relationships with the object 5, the images formed on the individual regions have different information as to the 
25 position of the image within the region, the intensity of the signal, and the lil<e. This is exploited, for details, refer to the 
descriptions of Fig. 9 A and Fig. 9B above. 

[0049] Rgs. 12A and 12B are diagrams schematically showing the principle of making the field of view of the Image 
input apparatus wider. As shown in Fig. 12A, each microlens L jj of the microlens anay 1 images a length of X jj on the 
object plane 5b on the object 5 onto the image formation surface 3b of the photosensitive element array 3. Since the 
30 individual microlenses L jj are located at different locations, they fomn images of different areas on the object surface 
5b. As shown in Fig. 12 B, such differences are increased by the use of deflecting member, which thus helps make the 
overall field of view wider. 

[0050] Thus, when shooting needs to be performed with a wider view angle instead of the microlens aray 1 , for 
example, a lens array 6 with a deflection function, i.e. a functional optical element having both deflecting and image- 
35 forming functions is used. This lens array 6 has deflecting elements 6a provided one for each unit. Thus, the fields of 
view V of the individual units combine to cover a wider area on the object 5. 

[0051] Deflecting elements having such a deflecting function can be realized not only with prisms but also with dif- 
fracting optical elements. Their material, manufacturing process, size, and others are common to the diffractive lenses 
described earlier Specifically, one method is to decenterthe center of a pattern, such as Fresnel zone plate, that has 

40 an image-formation function in the direction in which to diffract the incident light. Another method is to overlay a one- 
dimensioned diffraction grating on an image-fomning diffractive optical element. Both methods produce the same 
effects. When the deflection angle is relatively nan-ow, the former method is recommendable and when the deflection 
angle is relatively wide, the latter method is recommendable. How the field of view varies as a result of introduction of 
deflecting elements can be controlled by manipulating the parameters of each deflecting element. 

45 [0052] Fig. 13 is a diagram schematically illustrating an example of the construction based on the former method 
described above. In this diagram. ^ represents the amount of decentering of the Fresnel zone plate F, a represents the 
view angle, and f represents the focal length. Fig. 1 4 is a diagram schematically illustrating an example of the construc- 
tion based on the latter method described above. In this diagram, d represents the grating constant of the one-dimen- 
sioned diffraction grating DG, a represents the view angle, and X represents the wave length of the incident light. In both 

50 diagrams, I-, represents the incident light and Ig represents the diffracted light. Here, the decentering amount ^ and the 
grating constant d function as the above-mentioned parameters of each deflecting elements. The view angle a that 
each unit offers is equal to the deflection angle through whk:h the incident tight is deflected. Thus, Figs. 13 and 14 give 
formulae (a) and (b) below. 

55 a=tan'^(4/f) (a) 

a = sin'^ (mA./d) (b) 
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where m represents an integer number. When a diffraction grating Is used, a large number, corresponding to m, of kinds 
of diffracted light appear. However, for example by giving the diffraction grating blaze-shaped grooves, it is possible to 
obtain only one kind of diffracted light 

[0053] Fig. 1 5 is a perspective view schematically showing the construction of an image input apparatus employing 
a functional optical element to which a dispersive property is added. As shown in this diagram, which shows only a por- 
tion corresponding to one unit, as a functional optical element, a diffraction grating 7 is arranged above a photosensitive 
element array 3 so as to face it. Independent spectroscopes are formed one for each unit, so that the spectral data of 
different parts of the sensed object can be obtained. This diffraction grating 7, having different grating constants in the 
X and y directions indicated by an-ows in the diagram, deflects the incoming light L at different angles according to the 
wave length, and then leads the resulting optical signal as spectral light La to the photosensitive elements 3a located 
at different locations on of the photosensitive element array 3. 

[0054] Here, it is not necessary to provide a special filter for selecting particular wave lengths on the side of the pho- 
tosensitive element array 3, and therefor a so-called single plane photosensitive element can be used as it is. The pho- 
tosensitive elements 3a constituting each unit are arranged in a square shape, and by deflecting the optk^l signals of 
the spectral light La in such a way as to cover all the area of that square, it is possible to make efficient use of the pho- 
tosensitive elements 3a. 

[0055] The spectroscopes mentioned above are manufactured as diff ractive optical elements just like the polarizing 
fitters and deflecting elements described earlier. Therefore, they are produced from a quartz glass substrate by a similar 
manufacturing process. The pattern formed here is designed to have different predetennined grating constants in the x 
and y directions so that incident light is deflected at varying angles according to the wave length independently in each 

direction. 

[0056] Images obtained as a set of spectral data in this way have the following advantages and uses. Generally, an 
object is observed through a primary color filter when it is handed as visual information; however, more versatile infor- 
mation of the object can be obtained by using its spectral data. For example, different materials have different spectral 
absorption coefficients, and therefore it is possible to identify the materials constituting the object and investigate their 
distribution by measuring the spectrum absorbed by the object. Furthermore, this technique can be applied to an appa- 
ratus which checks the level of comfortableness, mental state, and the like of a subject person by measuring the per- 
son's perspiration by using the wave length information of the light absorbed by water. For details, refer to Japanese 
Laid-open Patent Application No. H8-184555. 

Claims 

1 . An image Input apparatus comprising: 

a photoelectric converter element having a flat photosensitive surface; and 

an image fonnation unit array having a plurality of image formation units arranged in an array, 

wherein the plurality of image formation units individually receive light beams substantially from an identical 

area and focus the received light beam on different regions of the photosensitive surface of the photoelectric 

converter element to form images thereon. 

2. An image input apparatus as claimed in claim 1 , 

wherein the Individual images formed on the different regions are images of an object lying In the area as seen from 
different view points. 

3. An image input apparatus as claimed in claim 1 , further comprising: 

a restricting member for restricting, independently for each of the plurality of image formation units, optical 
paths along which the light beams are focussed. 

4. An image input apparatus as claimed in claim 3, 

wherein the restriction member is realized as partition walls. 

5. An image input apparatus as claimed in claim 4, 

wherein those pixels of the photoelectric converter element which output a bright-state signal when light enters the 
plurality of Image fonnation units are regarded as effective pixels. 

6. An image input apparatus as claimed in claim 3, 

wherein the restricting member is a polarizing filter array having polarizing filters arranged one for each group of 
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the plurality of image formation units, every two adjacent polarizing filters having mutually perpendicular polariza- 
tion angles. 

An image input apparatus as claimed in claim 1, further comprising: 

deflecting members provided one for each of the plurality of image fomnation units. 

An image input apparatus as claimed in claim 1, further comprising: 

spectroscopic members provided one for each of the plurality of image fomnation units. 

An image input apparatus as claimed in claim 1, further comprising: 

a signal processing system for processing signals obtained as a result of photoelectric conversion perfomned 
by the photoelectric converter element by using processing functions provided one for each of the plurality of 
image fomnation units. 
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FIG.1 
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FIG.4C 




FIG.4D 
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FIG.5 
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FIG.6 




FIG.7 




FIG.8 
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FIG.9A 
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FIG.11 
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FIG.12A 
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FIG.14 




FIG. 15 
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